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Abstract 

We study a simple but compelling model of n interacting agents via time-dependent, unidirectional 
communication. The model finds wide application in a variety of fields including synchronization, 
swarming and distributed decision making. In the model, each agent updates his current state based 
upon the current information received from other agents. Necessary and/or sufficient conditions for 
the convergence of the individual agents' states to a common value are presented, extending recent 
results reported in the literature. Unlike previous, related studies, the approach of the present paper 
does not rely on algebraic graph theory and is of a completely nonlinear nature. It is rather surprising 
that with these nonlinear tools, extensions may be obtained even for the linear cases discussed in 
the literature. The proof technique consists of a blend of graph-theoretic and system-theoretic tools 
integrated within a formal framework of set-valued Lyapunov theory and may be of independent 
interest. Further, it is also observed that more communication does not necessarily lead to better 
convergence and may eventually even lead to a loss of convergence, even for the simple models 
discussed in the present paper. 

Keywords: multi-agent systems, stability analysis, swarms, synchronization, set-valued Lyapunov 
theory. 

1 Introduction 

Recent years have witnessed an increasing interest in the interaction between information flow and system 
dynamics. It is recognized that information and communication constraints may have a considerable 
impact on the performance of a control system. The study of these topics forms a very active area 
of research, giving rise to new control paradigms such as quantized control systems, networked control 
systems and multi-agent (multi-vehicle, multi-robot) systems. 

An important aspect of information flow in a dynamical system is the communication topology, which 
determines what information is available for which component at a given time instant. We study the role 
of communication topology in the context of multi-agent systems. Our interest in multi-agent systems is 
motivated by the emergence of several applications including formation flying of UAVs (unmanned aerial 
vehicles), cooperative robotics |31 1181 Irj) and sensor networks £Q. 
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In the present paper we consider a group of n agents, not necessarily identical. The individual 
agents share a common state space and each agent updates his current state based upon the information 
received from other agents, according to a simple rule. Our aim is to relate the information flow and 
communication structure with the stability properties of the group of agents. 

The model that we consider encompasses, or is closely related to, several models reported in the 
literature. A prominent and well-studied example concerns synchronization of coupled oscillators, a 
phenomenon which is ubiquitous in the natural world and finds several applications in physics and 
engineering; see f° r a review and a historical account. The Kuramoto equation |UJ^], which is 

widely accepted in that field, models a population of oscillators with (typically sinusoidal) coupling terms. 
The Kuramoto equation may be studied with the tools of the present paper. Another interesting example 
concerns swarming, a cooperative behavior observed for a variety of living beings such as birds, fish, 
bacteria, etc. In the physics literature, swarming models are often individual-based with each individual 
being represented by a particle moving with constant velocity, its direction of motion being updated 
according to nearest neighbor coupling; see, for example, the paper In recent years, engineering 

applications such as formation control have increased the interest of engineers in swarms ^| [5J [7|- 
The approach of the present paper applies to the swarming models discussed in |H] . A third and 
last example of multi-agent systems that fall within the scope of the present paper are the concensus 
algorithms studied in 1 1 . Consensus protocols enable a network of dynamic agents to agree upon 
quantities of interest via a process of distributed decision making. Agreement problems have a long 
history in the field of computer science and are currently finding applications in formation control of 
multi- vehicle systems [SJE]- 

We impose very weak assumptions on the communication topology; we allow for unidirectional and 
time-dependent communication patterns. Unidirectional communication is important for practical ap- 
plications and can easily be incorporated, for example, via broadcasting. Also, sensed information flow 
which plays a central role in schooling and flocking, is typically not bidirectional. In addition, we do not 
exclude loops in the communication topology. This means that, typically, we are considering leadcrlcss 
coordination rather than a leader-follower approach. (Leaderless coordination is also considered, for ex- 
ample, in [HI El El)- Finally, we allow for time-dependent communication patterns which are important if 
we want to take into account link failure and link creation, reconfigurable networks and nearest neighbor 
coupling. 

The contribution of the paper is twofold. We present necessary and/or sufficient conditions on the 
communication topology guaranteeing convergence of the individual agents' states to a common value. 
The results that we obtain extend the results reported in [Hl llfil lS|[Tl ] . A second contribution concerns the 
proof technique enabling us to obtain these results. Previous studies that have considered the connection 
between communication topology and system stability such as 0) UM_ typically rely on algebraic graph 
theory, relating the graph topology with the algebraic structure of associated graph matrices. In the 
present paper, instead of relying on algebraic graph theory, we propose a blend of graph-theoretic and 
system-theoretic tools to analyse stability. Our approach is of an inherently nonlinear nature with the 
notion of convexity playing a central role. It is rather surprising that with these nonlinear tools, extensions 
may be obtained even for the linear cases discussed in the literature. The analysis tools that we propose are 
integrated within a formal framework relying on set- valued Lyapunov functions and may be of independent 
interest. 

The paper is organized as follows. Section illustrates the main results of the paper by means 
of a simple example. Section [31 introduces the model that is studied in the remainder of the paper. 
Section 0] proposes a novel stability concept and a corresponding Lyapunov characterization; this may 
be of independent interest. Sections EH3 present necessary and/or sufficient conditions for convergence 
of the agents' states to a common, constant value. Section [5] summarizes the main results of the paper. 
Appendix lAl contains a graph-theoretic result that is used in the technical proofs of the paper. 
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Notation and terminology 

We distinguish between the set-inclusion symbols C and C. The symbol C denotes strict inclusion whereas 
C denotes non-strict inclusion. 

Let if be a subset of a finite-dimensional Euclidean space X. The set B(K,c) (c > 0) is defined as 
the set of points in X whose distance to K is strictly smaller than c. When K is a singleton {x} the 
notation B(x,c) is used instead of B({x},c). 

Consider finite-dimensional Euclidean spaces X and Y. We denote by V(Y) the collection of all closed 
subsets of Y. A set-valued function f : X =4 Y is a (single-valued) function / : X — > V(Y). A set-valued 
function / : X =4 Y is called upper semicontinuous if for every x € X and every e > there is 8 > such 
that f(y) € B(f(x),e) whenever y 6 <$). 

The relative interior of a convex set C in finite-dimensional Euclidean space is the interior which 
results when this set is regarded as a subset of its affine hull and is denoted by ri(C). A polytope is a set 
which is the convex hull of finitely many points. See |12j for more information. 



2 Example 

The present section illustrates the main results of the paper by means of a linear example. The results 
that we obtain for this example generalize results that have recently been reported in the literature. At 
the same time, the present section also introduces several notions that will be used repeatedly in the 
remainder of the paper (directed graph, neighbors, weak connectivity). 

Definition 1 (directed graph). A directed graph is a pair (A/ - , A) where Af is a nonempty, finite set 
and A is a subset of Af X Af satisfying (k, k) £ A for all k e Af. Elements of Af are referred to as nodes 
and an element (k, I) of A is referred to as an arc from k to I. 

Definition 2 (neighbors). Consider a directed graph (Af, A) and a nonempty subset C C Af. The 
set Neighbors(£, A) is the set of those nodes k G Af \ C for which there is I € £ such that (k,l) £ A. 
When C is a singleton {m}, the notation Neighbors(m, A) is used instead of Neighbors {{m}, A). 

Notice that any nonempty subset C C Af satisfies 

Neighbors (£, A) = (U me £Neighbors(m, A)) \C. 

Definition 3 (weighted directed graph). A weighted directed graph is a triple (Af, A, w) where (Af, A) 
is a directed graph and w : A — ► M>o is a map associating to each arc (k, I) a positive weight denoted 
by w k i . 

Consider, for example, the weighted directed graph depicted in Fig. ^ Each node in this graph 




o 

Figure 1: Weighted directed graph 

corresponds to an agent and each arc represents a communication channel. Each agent i (i = 1, . . . , 4) is 
being attributed a real state variable x% S R. Suppose that this weighted directed graph represents the 
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communication pattern at time t. Agent 1 receives information from agent 2 and updates his state X\ 
according to the weighted average 

l Xl (t) + (l/2)x 2 (t) 

Xl(i + 1) = TTT/2 ■ 

Notice that agent l's own state xi(t) is taken into account with unit weight 1. Agent 2 receives information 
from agents 1 and 3 and updates his heading x 2 according to the weighted average 

l Xl {t) + lx 2 (t) + 5x 3 (t) 

X2(i + 1) = iTTT5 • 

Agents 3 and 4 do not receive any information: 

x 3 (t+l) =x 3 (t), 

X^(t + 1) = Xj±{t). 

We are interested in the dynamics of the a^-variables of the agents that arises when the communication 
graph changes over time. In order to formulate the dynamics for general graphs, we associate to a 
weighted directed graph Q = (N ', A, w) with vertex set Af = {1, . . . , n) a real n x n-matrix A(Q) whose 
components we define as follows: 

!t-^ ^ whenever (/, k) e A, 

T+y 1 — whenever k = l, (1) 
otherwise. 

Notice that the matrix A{Q) is stochastic; that is, it is a square matrix with non-negative entries and 
with the property that its row sums are all equal to 1. For the weighted directed graph of Fig. ^ for 
example, the matrix A(Q) becomes 
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Consider a sequence of weighted directed graphs Q(t) = (A/", A(t), w(t)) with common vertex set N = 
{1, . . . , n} and where igN. We are interested in the following discrete-time system on R": 

x(t + 1) = A{g{t))x{t). (2) 

In particular, we want to formulate necessary and/or sufficient conditions for the convergence of the 
n components Xi{t) to a common value as t — > oo. It is clear that the convergence properties of Eq. @ 
depend both on the connectivity properties of the sequence of directed graphs and on the associated 
weight functions. In the present paper we focus on the role of the connectivity properties and assume 
that the weights are well-behaved by imposing a uniform boundedness condition. Below we state two 
results that follow as a consequence of the general theory established in the paper (Theorems |3] and 0J. 
The formulation of these results relies on the notion of weak connectivity. 

Definition 4 (weak connectivity). Consider a directed graph (A/", A). A node k 6 M is connected to 
a node I e AT if there is a path from k to I in the graph which respects the orientation of the arcs. A 
directed graph (A/ - , -4) is called weakly connected if there is a node k £ A/" which is connected to all other 
nodes I e Af \ {k}. A sequence of directed graphs (Af,A(t)) with t G N is called weakly connected across 
an interval I C N if the directed graph (Af, UteiA(t)) is weakly connected. 
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Proposition 1 (unidirectional). Consider a sequence of weighted directed graphs Q(t) — (N ', A(t), w(t)) 
with common vertex set Af = {1, . . . , n} and where t G N. Assume the existence of < e m - m < e max < oo 
such that the weight functions w(t) take values in [e m - m , e max ] for all ( e N. // there is T > such that 
for all to G N the sequence of directed graphs (Af,A(t)) is weakly connected across [to, to +T], then the 
n-components Ci{t) °f an U solution C, of Eq. (J2J converge to a common value as t — » oo. 

Proposition 2 (bidirectional). Consider a sequence of weighted directed graphs Q(t) — (Af , A(t),w{t)) 
with common vertex set Af = {1, . . . , n} and where t G N. Assume the existence of < e m j n < e max < oo 
such that the weight functions w(t) take values in [e m i n , e max ] for all t G N. Assume in addition that 
the graphs (Af,A(t)) are bidirectional for all t G N. If for all to G N the sequence of graphs (Af,A(t)) is 
weakly connected across [to, oo) 7 then the n-components Ci{t) of any solution £ of Eq. (0) converge to a 
common value as t — > oo. 

2.1 Discussion of Propositions [T] and [5] 

1 . Let us mention some of the subtleties involved in the study of Eq. (J2J • First of all, Eq. J5J belongs to 
the class of linear time-varying systems, whose stability properties are hard to analyse in general. 
Secondly, the equilibrium value to which the components are shown to converge, is not known 
explicitly; this equilibrium value depends both on the initial data and on the sequence of weighted 
directed graphs. Thirdly, it has been shown in [H] that, in general, there does not exist a time- 
invariant, quadratic Lyapunov function for Eq. (J2J- Partially motivated by this negative result, 
we put forward in the present paper a series of graph-theoretic and system-theoretic analysis tools 
which are not based on the linear structure of Eq. (J2J). This contrasts our approach with the 
approaches taken in [8] I14| which rely heavily on linear algebra and algebraic graph theory. 

2. For the special case that the weights are all equal to one, Eq. Q reduces to the model studied 
in [HI Theorems 1-2]. From a control perspective, an important contribution of [B] is that this 
work relates the information flow and communication structure with the stability properties of 
the group of agents. The results obtained in the present paper generalize the results from 
Theorems 1-2] in several directions. Apart from the observation that the present models are more 
general, it is important to notice that unlike [Sj we do not assume bidirectional communication 
(Proposition^) and, when we consider bidirectional communication, we do not assume uniformity in 
the connectivity condition (Proposition^ . It is rather surprising that with our inherently nonlinear 
approach, we are able to obtain generalizations of results recently reported in the literature, even 
when restricting attention to the linear case. 

3. As a corollary of Proposition we obtain the following graph theoretic result. A stochastic n x n- 
matrix A with positive diagonal elements has all but one of its eigenvalues strictly inside the 
unit circle (the only exception being the trivial eigenvalue 1) if (and only if — see Theorem the 
associated directed graph (A/", A) 

JV = {1, . . . , n}, A = {(k, I) € Af X J\F ; A ih > and k ± 1} 

is weakly connected. As before, we mention that we obtain this graph theoretic result using inher- 
ently nonlinear analysis tools. Moreover, the present approach enables us to go beyond this result 
by considering time-dependent stochastic matrices. 

3 Multi-agent dynamics 

We introduce here the dynamical equations that will be studied in the remainder of the paper. These 
equations model the interaction of n agents via time-dependent, unidirectional communication. The 
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individual agents share a common state space X which is assumed to be finite-dimensional Euclidean. 
We are interested in multi-agent dynamics that guarantee convergence of the individual agents' states to 
a common value. The dynamics considered in the present paper are governed by a discrete-time system 
on X n . Its formulation involves two ingredients: a time-sequence of directed graphs and a discrete-time 
map / determining the actual dynamics. 

Data 1 (communication graphs). A sequence of directed graphs (A/ - , A(t)) with common node set J\f — 
{1, . . . , n} and with t G N; 

Data 2 (discrete-time map). A continuous function f : N x X n — » X n . 

These ingredients give rise to the following discrete-time system on X n 

x(t + l) = f(t,x(t)) (3) 
or, expressed in terms of the individual agents' states, 

xi(t + 1) = fi(t,xi(t), . . .,x n (t)), 

x n (t + 1) = f n (t,xi(t), . . .,x n (t)). 

Here we have introduced the decomposition x = (x\, . . . , x n ) and / = (/i, . . . , f n ) corresponding to the 
product structure of X n . 

The directed graph (TV, Ait)) characterizes the inter-agent communication at time t. Each node of this 
graph corresponds to an agent and each arc represents a communication channel. The communication 
graph (TV, Ait)) determines the information that is available for the agents at time t and each agent 
updates its state based upon this information according to Eq. J3J). We impose two assumptions on the 
map / = (/i,...,/„). 

Assumption 1 (communication). For every time igN and for each agent k G {1, . . . , n} the value of 
the function fkit, ■) '■ X n — > X depends only on the states of agent k and agents i G Neighbors(fc, Ait)); 
that is, fk(t,x) = fk(t,x) whenever Xk = Xk and Xi — Xi for all i G Neighbors(fc, A{t)). 

Assumption 2 (convexity). Associated to each directed graph (Af,A) with node set AT — {l,...,n} 

and each agent k there is a continuous set-valued function ek(A) : X n =4 X satisfying 

1. 

f k (t,x) G e k (A(t))(x), Vt G N, Vx G X n ; (4) 

2. ekiA)ix\, . . . ,x n ) — {xk} whenever the states of agent k and agentsi G Neighbors(/c, A) are all equal 
and ek(A)(xi , . . . , x n ) is contained in the relative interior of the convex hull of the states of agent k 
and agents i G Neighbors(fc, A) whenever the states of agent k and agents i G Neighbors (fc, A) are 
not all equal. 

Remark 1. Recall that the values of a set-valued function (from Euclidean space to Euclidean space) are, 
by definition, closed sets. Assumption^ thus implies that ek(A){xi, . . . , x n ) is a compact set contained in 
the relative interior of the convex hull of the states of agent k and agents i G Neighbors(fc, A) whenever 
the states of agent k and agents i G Neighbors (fc, ^4) are not all equal. 

Assumption^captures the constraints that the communication topology is supposed to impose on the 
dynamics. Assumption is a strict convexity assumption. It implies that the state Xkit + 1) is a strict 
convex combination of the state Xk(t) and the states Xi{t) of agents i G Neighbors(fc, Ait)). Assumptions^ 
and are satisfied in various examples reported in the literature. 



G 



Example 1 (linear). The linear model of Section^ falls within the scope of the present study. Consider 
a sequence of weighted directed graphs Q(t) — (Af,A(t),w(t)) with common vertex set Af = {1, . . . , n} 
and where ( e N. Assume the existence of < e m i„ < e max < oo such that the weight functions w(t) 
take values in [e m i n , e max ] for all t £ N. The linear model studied in Section\^ corresponds to the case 
of X = M and f(t,x) = A(Q(t))x with the matrix A(Q) defined in Eq. The discrete-time map f 

satisfies Assumptions 00 with e(A)(x) being the set of all possible values A(Q)x that are obtained by 
considering all possible weighted directed graphs Q with arc set A and with weights contained in the 
compact interval [e m ; n , e max ]. 

Example 2 (synchronization) . Consider a population of oscillators that share a common state space S 1 . 
Denote the state of oscillator k by 9 k and consider for each communication graph (Af, A) the Kuramoto 
equation 1 161/ 

6 k =u k + ^2 sin (^ _ k = l,...,n, (5) 

ieNeighbors(fc,^l) 

where we have taken the coupling strenth equal to 1. Let us consider the case that the u> k are all 
equal. In this case we may assume without loss of generality (by introducing a rotating reference frame) 
that uj\ = ■ ■ ■ = Lu n = 0. We restrict attention to angles in the interval (— 7r/2, tt/2) and introduce local 
coordinates (— 7r/2, 7r/2) — > K : 8k > x k = tan(0fc). Expressed in terms of these local coordinates, the 
Kuramoto equation becomes 

x k = V X \ ^= ^: k = l,...,n, (6) 

■ CN • iu a\ V 1 + x i V 1 + x l 

The continuous-time system @ may be studied within the present framework by introducing its time- 
1 map tp(A) : R™ — > K™. Explicitly, consider a time-sequence (Af,A(t)) (t G N) and put f(t,x) — 
ip(A(t))(x). This discrete-time map f satisfies Assumptions^ and\^ with e(A)(x) = {ip(A)(x)}. Whereas 
most papers on synchronization restrict attention to time-independent, bidirectional coupling, the present 
paper allows to study synchronization of oscillators with time-varying and unidirectional coupling. 

Example 3 (consensus algorithm). The following nonlinear consensus protocol is studied in \14\ - 
Let X = R and consider for a given communication graph (A/", .4) the continuous-time system on X n 

±k= ^ lik{xi-x k ), k=l,...,n. (7) 

i£Neighbors(fc,.A) 

where the functions 7^ '■ K — > R are uneven, locally Lipschitz and strictly increasing for all (i, k) G A. 
The continuous-time system (j5J) may be studied within the present framework by introducing its time- 
1 map ip(A) : R™ — > K™. Explicitly, consider a time-sequence (Af,A(t)) (t G Nj and put f(t,x) — 
ip(A(t))(x). This discrete-time map f satisfies Assumptions^ and\^with e(A)(x) = {ip(A)(x)}. Whereas 
restricts attention to time-independent and bidirectional communication graphs, the present paper 
allows to study nonlinear consensus protocols with time-varying and unidirectional communication. 

Example 4 (swarming). The paper liyij proposes a simple model to investigate self-ordered motion in 
systems of particles with biologically motivated interaction. Their model consists of a collection of particles 
moving with constant velocity v. At each time step a given particle assumes the average direction of motion 
of the particles in its neighborhood with some random perturbation added. Denote the direction of motion 
of particle k by 9 k G S 1 . The following model is studied in jiyf 

9 k (t + 1) = arctan ( ^^MO) \ k= ^_^ (g) 

\-Lie{fc}UNeighbors(fc,.A(t)) COS (0i(t J J J 
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where we have omitted an additive disturbance term. Here A(t) characterizes the nearest neighbor cou- 
pling at time t. We restrict attention to angles in the interval (— tt/2, tt/2) and introduce local coordi- 
nates (— 7r/2, tt/2) M. : 9k ^ Xk = tan(#/-), as in Example^ The model © expressed in terms of these 
local coordinates falls within the scope of the present paper. Whereas the study in ]19f is based solely on 
simulations, the present appraoch enables us to make analytical statements about convergence. 

If the headings 9k are close to each other, then Eq. (JHJ may be approximated by the linear equation 

x k (t + l)= Yl k = l,...,n. (9) 

ie{fe}UNeighbors(fe,^l(*)) 

with Xk G K. This is the swarming model studied in fjffl and corresponds to the linear example of Section\^ 
with all weights equal to 1. Hence Eq. also falls within the scope of the present paper. 

Assumption [21 plays a central role in the forthcoming analysis. Its importance is already reflected in 
the following simple but appealing result. 

Lemma 1. Consider the -Data satisfying Assumption^ The set-valued function V : X n =t X 
defined for each x — (x±, . . . , x n ) G X n as the convex hull of {x±, . . . ,x n }, denoted by conv{:ci, . . . ,x n }, 
is non-increasing along the solutions of Eq. (J5J; that is, 

V(f{t, x)) C V(x) Vt G N, Vx € X n . (10) 

Proof. Assumption [21 implies 

fk(t,x) G e k {A{t)){x) Cconv{a;i,...,x„}, Vfc G {l,...,n}, Mt G N, Vx G X n , (11) 

from which Eq. (|10|l follows immediately. □ 

Within the current framework, the statement of LemmaQlmay seem almost trivial; it arises as a straight- 
forward consequence of Assumption^ However, the nontrivial contribution lies precisely in the observa- 
tion that many examples reported in the literature satisfy Assumption [21 and hence may be studied by 
means of Lemma ^ The set- valued function V serves as a measure for disagreement. In the forthcoming 
sections, we will use (a slight modification of) V as a set-valued Lyapunov function. The set-valued 
nature of the Lyapunov function turns out to be convenient as it enables the application of Lyapunov 
techniques in the present context, where convergence to non-isolated equilibria will be shown. 
We end the section with some remarks about the limitations of the present model. 

Remark 2 (non-strict convexity). Assumption^ is a strict convexity assumption. For some applica- 
tions, it may be desirable to relax this assumption. For example, the discrete-time system 

x k (t + l)= max ,^ a; i(*)> k=l,...,n (12) 

does not satisfy Assumption^ but satisfies instead a non-strict convexity assumption: Xk(t + 1) belongs to 
(the boundary of) the convex hull of the state Xk(t) and the states Xi{t) of agents i G Neighbors(fc, A(t)). 
The study of dynamical equations satisfying a non-strict convexity assumption instead of Assumption^ 
is beyond the scope of the present paper. 

Remark 3 (non-Euclidean space) . By assuming that the common state space for the individual agents 
is Euclidean, we exclude some global phenomena arising, for example, in synchronization of periodic 
motions and in attitude allignment problems fiffl . Indeed, the natural state space for the individual agents 
in these examples is respectively S 1 and 5*0(3) and the global features of the dynamics that are related to 
the nontrivial topology of these manifolds, fall outside the scope of the present method. Nevertheless, local 
issues can often be studied within the present framework, for example, by introducing suitable coordinate 
charts. This has already been illustrated in Example^ 
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4 Stability definitions 



In order to enable a clear and precise formulation of the stability and convergence properties of the 
discrete-time system (01, we extend the familiar stability concepts of Lyapunov theory to the present 
framework. Notice that we are interested in the agents' states converging to a common, constant value 
and that we expect this common value to depend continuously on the agents' initial states. This means 
that the classical stability concepts developed for the study of individual (typically isolated) equilibria are 
not well-adapted to the present situation. Alternatively, one may shift attention away from the individual 
equilibria and consider the stability properties of the set of equilibria. However, set stability does not 
fully capture the convergence properties that we are aiming at. This is illustrated, for example, by the 
well-known phenomenon that a trajectory may converge to the set of equilibria without converging to any 
of the individual equilibria. The stability notions that we introduce below incorporate, among others, the 
requirement that all trajectories converge to one of the equilibria. We believe that the notions introduced 
here constitute a natural framework for questions studied in coordinated control, formation stabilization, 
synchronization, etc. 

In the following definition we make a conceptual distinction between equilibrium solutions and equi- 
librium points: an equilibrium point is an element of the state space which is the constant value of 
an equilibrium solution. By referring explicitly to equilibrium solutions in the following definition, we 
distinguish the present stability concepts from the more familiar set stability concepts. 

Definition 5 (stability). Let X be a finite- dimensional Euclidean space and consider a continuous 
map f : N X X — > X giving rise to the discrete-time system 

x(t + l) = f(t,x(t)). (13) 

Consider a collection of eguilibrium solutions of Eq. 1|13|) and denote the corresponding set of equilibrium 
points by With respect to the considered collection of equilibrium solutions, the dynamical system 1|13|) 
is called 

1. stable if for each <pi G $ ; for all ci > and for all to G N there is c\ > such that every solution £ 
of Eq. (|13|) satisfies: if |C(^o) — 0i | < C\ then there is <f>i G $ such that \C(t) — 02 1 < C2 for all t > to; 

2. bounded if for each <f>\ G for all c\ > and for all to G N there is C2 > such that every 
solution £ of Eq. (|13|l satisfies: if |C(^o) — 01 1 < c\ then there is 02 G $ such that \C{t) — 4>2\ < c-2 
for all t > to; 

3. globally attractive if for each <fii G $, for all Ci,C2 > and for all t a G N there is T > such 
that every solution ( of Eq. I|13|) satisfies: if |C(io) — 0i | < c\ then there is 02 G $ such that 
ICW -^2 1 <c 2 for allt>t + T; 

4- globally asymptotically stable if it is stable, bounded and globally attractive. 

Remark 4. We may take without loss of generality <f>2 = 4>i in Items^\ and\^ of Definition^ (but not 
in Item\$). Compare with the proof of Theorem^] below. We have chosen not to incorporate <f>2 = 4>i in 
Items^\ and\^ in order to make the similarities with Item\Qmore transparent. 

Dcfinition[S]may be interpreted as follows. Stability and boundedness require that any solution of Eq. I|13|) 
which is initially close to $ remains close to one of the equilibria in thus excluding, for example, the 
possibility of drift along the set <&. Global attractivity implies that every solution of Eq. II 1311 converges 
to one of the equilibria in If the collection of equilibrium solutions is a singleton consisting of one 
equilibrium solution, then the notions of stability, boundedness, global attractivity and global asymptotic 
stability of Definition El coincide with the classical notions that have been introduced for the study of 
individual equilibria. 
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Slightly stronger stability notions result when uniformity with respect to initial time is introduced 
in Definition If the number c\ (respectively C2 and T) may be chosen independently of to in Item ^ 
(respectively Items and |3J| then the dynamical system (|13f) is called uniformly stable (respectively uni- 
formly bounded and uniformly globally attractive) with respect to the considered collection of equilibrium 
solutions. 

Theorem ^ below provides a sufficient condition for uniform stability, uniform boundedness and uni- 
form global asymptotic stability in terms of the existence of a set- valued Lyapunov function. This result 
is convenient since, on the one hand, set-valued Lyapunov functions arise naturally within the present 
context as illustrated by Lemma ^ an d 011 the other hand, the stability notions that are asserted in 
Theorem ^ are precisely those that we are aiming to prove. Apart from its application in the present 
paper, Theorem^niay be of independent interest. 

Theorem 1 (Lyapunov characterization). Let X be a finite- dimensional Euclidean space and consider 
a continuous map f : N x X ^ X giving rise to the discrete-time system Ijl3|l . Let 5 be a collection of 
equilibrium solutions of Eq. (|13J) and denote the corresponding set of equilibrium points by <&. Consider 
an upper semicontinuous set-valued function V : X =4 X satisfying 

1. x e V(x), Vx e X\ 

2. V(f(t,x)) c V(x), Vt eN, Vie X. 

If V ((f) = {</>} for all (j> G $ then the dynamical system is uniformly stable with respect to S. IfV{x) 
is bounded for all x G X then the dynamical system is uniformly bounded with respect to H. 

Consider in addition a function \l : Image(U) — » R>o and a lower semicontinuous function (3 : X — > 
K>o satisfying 

3. pioV : X — > R>o : x i— ► fi(V(x)) is bounded uniformly with respect to x in bounded subsets of X ; 

4- P is positive definite with respect to $; that is, P(4>) = for all <f> G $ and f3(x) > for all x G X\$>; 

5. fi(V(f{t, x))) - fJ,(V(x)) < -P(x), Vt G N, Vx G X. 

If V(4>) — {4>} for all <f> G $ and V(x) is bounded for all x G X then the dynamical system is 
uniformly globally asymptotically stable with respect to S. 

We briefly comment on the role of the functions V, [i and (3 in Theorem ^ The set- valued function V 
plays the role of a Lyapunov function which is non-increasing (decreasing) along the solutions of Eq. (fblf . 
The set-valued nature of V is crucial. A set-valued function allows for a continuum of minimal elements 
which are not comparable with each other. For this reason, a set- valued Lyapunov function, unlike a real 
Lyapunov function, may be used to conclude that each trajectory converges to one equilibrium out of a 
continuum of equilibria. The function fi serves as a measure for the size of the values of V. In the present 
paper, we let /i(V(x)) be the diameter of the set V(x). The function /3 characterizes the decrease of V 
along the solutions of Eq. (|13|l as measured in terms of \i. 

Proof of Theorem^ (Uniform stability.) Consider arbitrary and C2 > 0. If V(4>\) — {4>i} then, 

by upper semicontinuity of V, there is c\ > such that V(x) C B((f>\,C2) for all x G B(<j>i, c\). Consider 
arbitrary to G N and xo G B((j>\, Cx) and let C, denote the solution of Eq. lpH!|) with C(*o) = Conditions^ 
and 13 of the theorem imply that 

C(t) G V(C(t)) C V(x Q ) G B(cf> u c 2 ), Vt > t . (14) 

(Uniform boundedness.) Consider arbitrary <j>t G $ and c\ > 0. If V(x) is bounded for all x G X 
then, by upper semicontinuity of V, there is C2 > such that V(x) C ^(^1,02) for all x G S(0i,ci). 
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Consider arbitrary to G N and x G B(<fii,ci) and let ( denote the solution of Eq. IT^jl with ((to) — x . 
Conditions H an d 121 of the theorem imply that 

C(t) G V(C(t)) C K(a;o) C B(0i, 02), Vt > t . (15) 

(Uniform global asymptotic stability.) We have already proved that, if V(tf>) — {</>} for all <f> G $ 
and V(a;) is bounded for all x G then the dynamical system 1)13(1 is uniformly stable and uniformly 
bounded with respect to S. It remains to prove uniform global attractivity with respect to S. 

Consider arbitrary G $ and ci > 0. If V(x) is bounded for all x G A" then, by upper semicontinuity 
of V, there is a compact set K C X such that V(a;) C K for all a; G 2?(</>i,ci). Similarly as above, 
Conditions ^ an( i El °f the theorem imply that every solution of Eq. I|13fl initiated in B(4>\, c\) remains in 
K. 

Consider in addition arbitrary C2 > 0. If V(<f>) — {</)} for all <j> G $ then, by upper semicontinuity of V, 
there is C3 > such that for all x G $(<!> PI X, C3) there is 02 G $ such that V(x) C B(<p2, 02)- Similarly 
as above, Conditions 2] and [21 of the theorem imply that every solution of Eq. (|13fl entering £>($ fl ii", C3) 
remains in a C2-ball around some equilibrium point ^ £$. 

It remains to prove the existence of T > such that every solution of Eq. (|13(l starting in B((f>±, c\) 
cannot remain longer than T subsequent times in K without entering £?($ PI K, C3). In agreement with 
Conditions and 0] of the theorem and the lower semicontinuity of j3, we introduce two real numbers 

M = sup fi(V(x)) < 00 

xGZ3(0i,ci) 

and 

A = min B(x) > 0. 
ieff\B(*,c 3 ) 

Let T > be such that TA > M. Consider arbitrary to G N and xo G B(0i,ci) and let £ denote the 
solution of Eq. I|13|) with£(<o) = £o- Then Condition|31of the theorem implies that for some t\ G [to, to+T] 

C(ti) GS($n^,c 3 ), 

since otherwise /i(V(C(*o + would be smaller than zero, contradicting that /i takes only non-negative 
values. Putting everything together, we conclude that for some (f>2 G $ 

at)EV(((t))CV(((t 1 ))cB(<f>2,C2), Vt>t +T. (16) 

□ 

Remark 5. TTie strict decrease condition (Conditional of Theorem ^\ may be considerably relaxed. 
Consider, for example, the following condition which requires that [ioV decreases over time-intervals of 
length r 

6. There is a time r G N such that 

fi(V(f(t + r - 1, . . . f(t + 1, f(t, x))... ))) - (i(V(x)) < -f3(x), Vf G N, Vx G X. (17) 

Theorem^ is still true if Condition^ is replaced by Condition^ 

Remark 6. The Lyapunov functions featuring in Theorem Q are set-valued functions V : X =4 X, 
or equivalently, single-valued functions V : X — > V(X). One may be interested in generalizations of 
Theorem Q considering more abstract Lyapunov functions V : X — > Z with Z not necessarily equal 
to V(X). The determination of appropriate structures and properties for the set Z and the function V 
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enabling Lyapunov-type of results is beyond the scope of this study. Nevertheless, we point out that a 
partial ordering of the set Z seems to be an essential ingredient in order to be able to conclude that every 
solution converges to one equilibrium out of a continuum of equilibria. It turns out that the class of 
set-valued functions V : X =4 X is universal in this context, in the following sense. Consider a set Z 
and let -< by a strict partial ordering of Z } Consider a set X and a function V : X — > Z . Introduce for 
every x G X the subset V(x) C X defined by 

V(x) = {x € X : V{x) -< V(x) or V(x) = V(x)}. 

Then we have V(x) = V(x) whenever V{x) — V(x) and V(x) C V(x) whenever V(x) -< V(x). The proof 
of this statement is elementary and therefore omitted. Not only does this result provide some motivation 
for restricting attention to set-valued maps V : X =4 X in Theorem^ it also points towards a constructive 
method for finding such set-valued Lyapunov functions. See, for example, the proof of Theorem^ 

We have the following consequence of Theorem ^ and Lemma ^ 

Theorem 2. Consider the Data^W^ satisfying Assumption^ The discrete-time system @ is uniformly 
stable and uniformly bounded with respect to the collection of equilibrium solutions X\(t) = • • • = x n (t) = 
constant. 

Proof of Theorem In order to apply Theorem ^ we introduce the set-valued function V : X n =4 X n 
according to 

V{x u ...,x n ) = (convex, . . .,x n }) n , Vx e X n . 

The set-valued function V is derived from V following the procedure of RemarkElwith V(X), C playing 
the role of Z,<. The set- valued function V is easily seen to be globally Lipschitz. Theorem |21 follows 
immediately from Theorem ^ an d Lemma ^ d 



5 Uniform global attractivity 

Contrary to what might be expected from Lemma ^ or Theorem [3 the dynamics of Eq. © may be 
surprisingly complex. For example, the agents' states may fail to converge to a common value, even in 
the presence of inter-agent communication. In the remainder of the paper, a blend of graph-theoretic and 
system-theoretic tools will be used in order to establish necessary and/or sufficient conditions for global 
attractivity. 

In the present section we restrict attention to global attractivity uniform with respect to initial 
time. We provide a necessary and sufficient condition for uniform global attractivity of Eq. J3j. The 
condition that we present does not involve the actual discrete-time map /; it only involves the sequence 
of communication graphs (Af,A(t)). 

Theorem 3 (uniform global attractivity). Consider the Data^^ satisfying Assumptions^^ The 
discrete-time system (J3J) is uniformly globally attractive with respect to the collection of equilibrium solu- 
tions x±(t) = ■ ■ ■ = x n (t) = constant if and only if there is T > such that for all to £ N the sequence of 
communication graphs is weakly connected across [to, to+T]. 



x We adhere to the convention of 1131 according to which a partial ordering -< of a set Z is a transitive and antisymmetric 
relation on Z. If we never have z -< z then H is called a strict partial ordering. 
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Proof of Theorem^ (Only if, proof by contraposition.) Assume that for every T > there is to £ N such 
that the sequence of communication graphs is not weakly connected across [to , to + T] . By Theorem 
in the Appendix, this implies that for every T > there is to £ N and there are nonempty, disjoint 
subsets C\,C2 C Af such that Neighbors {Cx,A{t)) and Neighbors^) <A.(t)) are both empty for all t £ 
[to, to+T). Pick two different elements y,y £ X and consider any solution £ of Eq. © with initial data 

[=y VjeA, 
Ci(<o) =y Vie£ 2 , (18) 

[ 6 convey} Vj £ JV\ (A U £ 2 )- 
Assumption [3 implies that, at time to + T + 1, we still have 

Ci(*o + T + iW = v V?e£ 2 , (19) 

[econv{y,y} Vj G M\ (£i U £ 2 ), 

since Neighbors(£i, .A(f)) and Neighbors(£ 2 , ^4(t)) are both empty for all t £ [to, to +T]. As the time T 
may be chosen arbitrarily large, it is not difficult to see that this contradicts uniform global attractivity 
of Eq. JjJJl with respect to the equilibrium solutions x\(t) = • ■ ■ = x n (t) = constant. 

(If.) Let T > be such that for all to G N the sequence of communication graphs is weakly connected 
across [to, to + T]. Consider an arbitrary solution £ of Eq. @ and an arbitrary time to E N and assume 
that the Cj'(*o)'s (j £ N) are not all equal. We first show that V(((t + (n - 1)(T + 1))) is strictly 
contained in V(£(to)), where V is the set-valued function introduced in LemmaQ] 

In order to show this, we introduce a number of auxiliary functions. Denote the to vertices (2 < 
m < n) of the polytope V(C(to)) by j/i, . . . ,y m £ X. Associate to each vertex the set-valued function 
a,i : [to, oo) N identifying the agents located at that vertex: 

a t (t) = {j £ AT : Q(t) = Vi }, Vt G [to, oo), Vt = 1, . . . , m. (20) 

The strict convexity assumption (Assumption |2J) implies that an agent which is not located at a vertex yi 
at some time t > to can never reach this vertex in finite time: 

Oi(i + 1) C Oi(i), Vt G [t , oo), Mi = 1, . . . ,m. (21) 

We now establish a strict decrease property for the functions at. We show that, under the connectivity 
assumption of the theorem, at least m — 1 of the functions oi, . . . , a m are empty- valued at t = to + (n — 
1)(T + 1). Consider any intermediate time interval [t + p(T + 1), t + p(T + 1) + T] (p = 0, . . . , n - 2). 
The assumption of the theorem implies the existence of an agent k which is connected to all other agents 
across [to + p(T + 1), t + p(T + 1) + T\. We distinguish two cases. 

1. If agent k is located in one of the vertices at time to + p(T + 1); that is, if there is i £ {1, . . . , m} 
such that k £ eij(io + p(T + 1)), then all the other vertices j £ {1, . . . , m} \ {i} where agents are 
located at time to +p(T+l) (that is, a,j(t +p(T+l)) ^ 0) satisfy the following: Neighbors(aj(t + 
p(T+l)),A(t)) ^ for some t £ [t +p(T+l), t Q +p(T+l)+T] and hence, by the strict convexity 
assumption (Assumption |2J), a,j(ta + (p + 1)(T + 1)) is strictly contained in aj(to + p(T + 1)). 

2. If agent k is not located in one of the vertices at time to +p{T + 1); that is, if k ^ Oj(io +p{T +1)) 
for all j £ {1, . . . , to}, then all vertices j £ {1, . . . , to} where agents are located at time to +p(T+ 1) 
(that is, a,j(t +p(T+l)) ^ 0) satisfy the following: Neighbors(a, (t +p(T+ 1)), „4(t)) ^ for some 
t £ [to +p(T + 1), to +p(T + 1) +T] and hence, by the strict convexity assumption ( Assumption 
aj(to + (p + l)(r + 1)) is strictly contained in a 3 (to + p(T + 1)). 
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Since the above argument holds for every time interval [to + p(T +1), to +p(T + 1) + T] (p = 0, . . . , n — 2) 
and since the maximum number of agents at each vertex at time to is not greater than n— 1, we may thus 
conclude that at least m — 1 of the functions oi, . . . , a m are empty- valued at t = to + (n — 1)(T+ 1). This 
establishes a strong decrease property for the set-valued function V. The polytope V(((t + (n— 1)(T+1))) 
is strictly contained in the polytope V(C(to)) and both sets have not more than one vertex in common. 

In order to prepare for an application of Theorem^ we introduce the set-valued function V : X n =$ X n 
according to 

V(x 1 ,...,x n ) = (comr{x 1 ,...,x n }) n , Vt G N, G A™, 

similarly as in the proof of Theorem |5J In addition we also introduce a real- valued function (3 : X n — > K 
according to 

0(x) = inf /i(V(Co)) - M(^(Cr)), r = (n - 1)(T + 1) (22) 

COviCt 

where /i denotes the diameter of a set and where the infimum is taken over all sequences Co , ■ • ■ > Cr i n A™ 
satisfying 

Co = x, 

Ci G eM(to))(Co), 

(23) 

Cr eeC/4(to + T-l))(Cr-l), 

for some to G N. The Ci may be interpreted as the states that are possibly reachable from x in i time 
steps according to Assumption [21 

We establish some useful properties of (3. First, the collection of all sequences Co,---jCt m X n 
satisfying (|23Jl for some to G N 

• is nonempty and compact for all x G X": 

• depends continuously on x. 

This follows from the observations that the set-valued functions e(A) : X n =^ X n are continuous and take 
nonempty, compact values (implied by Assumption |2J) and that there is only a finite number of possible 
sequences of t communication graphs. Secondly, the expression /Lt(V(Co)) — l^(V(Cr)) being minimized 
in igU 

• depends continuously on Co and £ T : indeed, this follows from the global Lipschitz character of V; 

• is zero whenever the n components of x are all equal: indeed, in this case Assumption [21 implies 
that Co = • ■ • = Cr = x is the only sequence satisfying (12,'j[| for some to G N; 

• is strictly positive whenever the n components of x are not all equal: indeed, this follows from the 
strict decrease property of V that has been established above and the observation that V(x) = 
(V(x)) n . 

Putting all elements together, we conclude that the function (3 : X n — > M is continuous and positive 
definite with respect to {(x%, . . . , x n ) G X n : xi = ■ ■ ■ = x n }. 

The proof is concluded with an application of Theorem ^ (see Remark EJ) which establishes uniform 
global asymptotic stability of Eq. J2Jl . □ 
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6 Non-uniform global attractivity 



The previous section has presented a necessary and sufficient condition for uniform global attractivity. Not 
surprisingly, this necessary and sufficient condition involves a connectivity requirement on the sequence of 
directed graphs, uniform with respect to initial time. In the present section, we turn attention to global 
attractivity, not necessarily uniform with respect to initial time. Unlike the previous section, where the 
situation is quite clear, the study of non-uniform attractivity turns out to be much more subtle. We start 
with a necessary condition for global attractivity, not necessarily uniform with respect to time. 

Proposition 3 (global attractivity). Consider the Data satisfying Assumptions QHU Global 
attractivity of the discrete-time system © with respect to the collection of equilibrium solutions X\(t) = 
• • • = x n (t) = constant implies that for all to G N the sequence of communication graphs is weakly 
connected across [io, oo). 

The proof of Proposition is very similar to the proof of the only i/-part of Theorem and is omitted. 
The necessary condition featuring in Proposition 03 may be interpreted as a non- uniform version of the 
necessary and sufficient condition featuring in Theorem [3J It may therefore seem tempting to conjecture 
that this necessary condition is also sufficient for global attractivity, not necessarily uniform with respect 
to time. However, the following counterexample shows that this is not the case. 



6.1 Counterexample 

The counterexample is concerned with three agents sharing a common state space X = R. Among all 
possible directed graphs on the vertex set {1, 2, 3} we consider 

A = {(1,2)}, 

A = {(1,2), (2,1)}, 

A = {(3,2)}, 1 > 

Ai = {(2,3), (3,2)}. 

We will introduce a sequence of directed graphs which consists of the concatenation of finite sequences 
of the form B s (s e {0} U N): 

Bg jA & , . . . , j\ & , 5 *Aq , •■• , Ac , ^4{i • 

2s 2s+l 

Proposition 4. Let the number of agents be given by n = 3 and consider the sequence of communication 
graphs (Af,A(t)) with t £ N corresponding to the concatenation Bq, B\, B2, -B3, . . . Let the common state 
space for the individual agents be given by X = R and consider the discrete-time map f corresponding 
to the linear example of Section^ with all the weights equal to one. Let Q be the solution of Eq. @ with 
initial data Ci(l) = and Ca(l) = £3(1) = 1. Then the three components of do not converge to a 
common value as t — > 00. 

Proof. In order to show that the three components of do not converge to a common value as t — > 00, 
we evaluate the difference C3 — Ci a * the sequence of time-instants t\ , t%, t$, ■ ■ ■ — » 00 determined by 
tp+i — t p = p+ 1 for all p € N and ti = 2 (Fig.EJ. For the ease of notation, let us denote ^(tp) — (i(t p ) 
by v(p). It is not difficult to see that 

1 2 P+1 — 1 

v(p + 1) = v(p) - ^+iv(p) = 2p+1 v(p), Vp € N, (25) 
«(1) = 1/2, (26) 
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Figure 2: Counterexample 



from which it follows that < v(p) < 1 for all pgN. Clearly v(p) is decreasing with p and converges to 
a limit as p —> oo. The total accumulative decrease of v satisfies 

OO OO -. 

]T (v(p) - v(p + !))=£ -^(p) (27) 



2p 

p—i p—i 



where we have used the recursive relation 1251) and the observation that < v(j>) < 1 for all p£N. Since 
= 1/2 we conclude that 



lim ( 3 (t p ) - Ci(*p) = lim «(p) = «(1) - V («(p) - «(p + l)) > 0. (29) 

□ 



p — >oo p — >oo 

p=l 



6.2 Discussion of counterexample 

1. First of all, notice that the sequence of directed graphs featuring in the counterexample satisfies 
the necessary condition of Proposition |3J The union of the arc sets A(t) over any interval of the 
form [to, oo) is given by {(1, 2), (2, 1), (2, 3), (3, 2)} which corresponds to a connected, bidirectional 
graph. This counterexample thus clearly shows that the necessary condition of Proposition|21is not 
sufficient for global attractivity. 

2. The counterexample points towards a non-intuitive phenomenon, namely that more information 
exchange does not necessarily lead to improved convergence properties, and may eventually even 
destroy convergence of the agents' states to a common value. To be more precise, if we replace the 
arc sets An and Ac by the empty set, which results in reduced communication, then the discrete- 
time system featuring in Proposition 0] becomes globally attractive. By taking A a and A c as 
defined in (|24|) instead of the empty set, which increases the communication, the agents' states 
fail to converge to a common value. It is, of course, well-known that more feedback does not 
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necessarily mean improved convergence, but we are inclined to believe that the present phenomenon 
is different from previously observed, similar phenomena. To illustrate this, let us note that the 
loss of convergence observed in the counterexample can only occur in the context of time-dependent 
and unidirectional communication (see Theorem [3] and Theorem 0] of the next section). 

7 Bidirectional communication 

The study of global attractivity of Eq. ©, not necessarily uniform with respect to initial time, is simplified 
considerably when bidirectional communication is assumed. 

Theorem 4 (bidirectional). Consider the Data^^^ satisfying Assumptions^^ Assume in addition 
that the communication graphs (J\f,A(t)) are bidirectional for all t G N. The discrete-time system is 
globally attractive with respect to the collection of equilibrium solutions X\(t) = • • • = x n {t) = constant if 
and only if for all to G N the sequence of bidirectional graphs (J\f,A(t)) is connected across [to, oo). 

The proof of Theorem 0] is based on an analysis of w-limit sets. It is, of course, well-known that w-limit 
sets play a central role in the stability analysis of dynamical systems through the celebrated LaSalle 
principle, but it is quite remarkable that the notion of cj-limit set proves to be useful in the present 
context, since we are considering time-varying dynamical systems, not necessarily periodic. 

Proof of Theorem^ (Only if.) This follows from Proposition Eland the observation that a bidirectional 
graph is connected if and only if it is weakly connected. 

(If.) It suffices to prove that every solution of Eq. J3J) converges to one of the equilibrium solutions 
X\{t) = ■ ■ ■ = x n (t) = constant. Indeed, by continuity and compactness arguments, convergence of all 
individual solutions actually implies global attractivity in the sense of Definition The observation that 
compactness may be invoked is not trivial (since the set of equilibrium points is unbounded) but follows 
from the boundedness property of Eq. J2J established in Theorem |2 

In the remainder of the proof we show that every solution of Eq. converges to one of the equilibrium 
solutions x%(t) = ■ ■ ■ = x n (t) = constant. Consider arbitrary ^ e N and xq G X n , and let ( denote the 
solution of Eq. J3J) with initial data C(^o) = x$. Let f2 denote the w-limit set of (. We start with observing 
that 

V(x) = V(x), Vi.iefi, (30) 

where V is the set- valued function introduced in Lemma ^ Indeed, the existence of G fl with 
V (x) V(x) would contradict the non-increase property established in Lemma^ We denote the constant 
value of V on Q by V(fl). 

Clearly, in order to establish that ^ converges to one of the equilibrium solutions x±{t) = • • • = x n (t) = 
constant, it suffices to prove that V(yi) is a singleton. We prove this by contradiction. Assume that V(yi) 
is not a singleton. In this case, V(fl) is a polytope with m vertices (2 < m < n) which we denote by 
yi, . . . , y m G X. We associate to each vertex yi a set-valued function hi : X n =4 A/" identifying the agents 
located at that vertex: 

bt(x) = {jeM: x.j = Vi }, \fx G X n , Vi = 1, . . . ,m. (31) 
Observation 130fl implies that 

6 i ( x )^0 j Vx G Q, Vi = l,...,m. (32) 
We arrive at a contradiction with the aid of the following result. 

Claim 1. If the connectivity condition mentioned in Theorem^holds, then for every x G £1 with bi(x) 
for all i G {1, . . . , to} there exists x G Q with bi(x) strictly contained in bi(x) for some i G {1, . . . , to}. 
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Indeed, a repetitive application of this result eventually leads to the existence of x* 6 f2 with &,(#*) = 
for some i G {l,...,m}, contradicting (|32|l . We have thus shown, by contradiction, that V(fl) is a 
singleton and thus that £ converges to one of the equilibrium solutions x\(t) = ■ ■ ■ = x n (t) = constant. 

We end the proof of Theorem 0] with a proof of Claim ^ Consider an arbitrary x G ft with 6i(x) ^ 
for all i G {1, . . . , to}. There is, by definition, a sequence of times t q (q G N) tending to infinity such 
that C(tq) —>■ x as q oo. Based upon the sequence of times t q we construct another sequence of times t q 
(q G N) tending to infinity, as follows. Let for each geN the time t q be defined as the first time greater 
than or equal to t q at which communication occurs between an agent k G bi (x) and an agent I G" bi (x) for 
some i G {1, . . . , m}: 

t q = min{t G [t q , oo) : Neighbors^ (x), A(t)) ^ for some i = 1, . . . , to}, Vg G N. 

The validity of this construction follows from the connectivity condition of Theorem 0] that we are 
assuming to hold. We may assume without loss of generality (by considering an appropriate subsequence 
if necessary) that 

1. the C,{t q ) converge to a limit point x G ft as q — > oo (by boundedness of the solution £); 

2. the A(t q ) are all equal, say, A(t q ) = A for all q G N (since there is only a finite number of possible 
communication graphs) ; 

3. the C(i g + 1) converge to a limit point x G ft as q — > oo (by continuity of the set-valued map e{A) 
and compactness of e(A){x) implied by Assumption 0) . 

It follows that x G e(A)(x). By construction of the sequence of times t q we conclude that, on the one 
hand, bi{£) = bi(x) for all i G {1, . . . ,to}, and, on the other hand, bi(x) is strictly contained in bi(x) 
for some i G {l,...,m} (by Assumption [21 . This concludes the proof of claim and hence also of 
Theorem H □ 



8 Conclusion 

We have considered in the paper a simple but appealing model for n interacting agents via unidirectional 
and time-dependent communication. This model finds wide application in a variety of fields including 
synchronization, swarming and distributed decision making. In the model, each agent updates his state 
based upon the information received from other agents, according to a simple rule. By considering simple 
dynamics for the individual agents, we are able to focus on the main aspects of communication topology 
without having to deal with the additional complications arising from complex dynamical agents. 

The analysis starts with the assumption that each agent updates his state according to a strict convex 
combination of its neighbors' states, an assumption which is satisfied in various examples studied in the 
literature. This assumption leads to the development of a set-valued Lyapunov theory, with the convex 
hull of the individual agents' states playing the role of a non-increasing Lyapunov function. Contrary 
to what might be expected, the dynamics of the multi-agent system turns out to be quite subtle and a 
blend of graph-theoretic and system theoretic tools is used in order to obtain necessary and/or sufficient 
conditions for convergence. 

The strongest result is obtained for the case of bidirectional communication. In that case, it is shown 
that convergence of the individual agents' states to a common value is guaranteed if, during each interval 
of the form [to, oo), each agent sends information to each other agent, either through direct communication 
or indirectly via intermediate agents. 

The case of unidirectional communication is more subtle. It is shown by means of a counterexample 
that, contrary to what might be expected, convergence of the individual agents' states to a common 
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value is not necessarily guaranteed, even if during each interval of the form [to, oo) there is an agent who 
sends information to all other agents, either through direct communication or indirectly via intermediate 
agents. Convergence is proven, however, if a uniform bound is imposed on the time it takes for the 
information to spread over the network. 

The counterexample that is used to show that the agents' states may fail to converge to a common 
value, even in the presence of communication, points towards a counter-intuitive phenomenon. Namely 
that more information exchange does not necessarily lead to improved convergence and may eventually 
even lead to a loss of convergence, even for the simple models studied in the present paper. The study 
of the quantitative relationship between communication topology and speed of convergence remains an 
interesting area of further research. 
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A Graph-theoretic result 

Theorem 5. A directed graph (Af, A) is weakly connected if and only if every pair of nonempty, disjoint 
subsets £i, £2 C M satisfies Neighbors (£ i, A) U Neighbors^, A) ^ 0. 

Proof. (Only if.) Assume that the node k is connected to all other nodes, and consider an arbitrary pair 
of nonempty, disjoint subsets A, £2 C Af. We distinguish three cases. 

1. If k € C\ then Neighbors(£2, A) is nonempty. 

2. If k £ £2 then Neighbors(£i, .4) is nonempty. 

3. If k £1 Li £2 then Neighbors(£i, .4) and Neighbors(£2, A) are both nonempty. 

In all three cases Neighbors (£ 1, .4) U Neighbors (£2, A) ^ 0. 

(If.) The proof consists of a constructive algorithm that is guaranteed to terminate in a finite number 
of steps. Each step i e N (except the last step) involves the selection of four nonempty sets L\(i) C 
C Af and £ 2 (z) C F 2 (i) C Af satisfying: 

• J-i{i) and ^(i) are disjoint; 

• each node in C\(i) is connected to each other node in fF\(i) and each node in £2(2) is connected to 
each other node in ^{i). 

Step 1. Set £i(l) = •T'i(l) = { m i} and £2(1) = -^(l) — {^i}> where mi and mi are two arbitrary, 
different nodes of the graph. (Here we have assumed that the graph has at least 2 nodes. If the graph 
has only one node, then the statement of Theorem is trivial.) 

Step i > 1. As we are proving the «/-part of the theorem, we may assume that Neighbors(£i(i — 1), A) Li 
Neighbors(£2(« — 1)7-4) 7^ 0- We restrict attention to the case Neighbors^ (i — l),-4) ^ and consider 
m,i G Neighbors(£2(i — 1), -4). (The alternative case of Neighbors(£i(i — 1), A) ^ can be dealt with in a 
completely similar way, be interchanging the role of £1 and £2, respectively T\ and J-2-) We distinguish 
four cases: 

1. If mi £ T\(i — 1) and T\(i — 1) U 7-i[i — 1) = N, then the algorithm terminates: any agent 
rh~i e £i(z — 1) is connected to all other agents in the graph. 
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2. If mi e - 1) and T x (i - 1) U T 2 (i - 1) ^ TV, then set 



£i(t)=£i(i-l), (33) 
^i(i)=^i(i-l)U^ 2 (i-l), (34) 
C 2 {t)=Mi) = {rni}, (35) 

where TOj is an arbitrary node which does not belong to T\{i — 1) U T 2 {i — 1). 

3. If £ - 1) U T 2 ii - 1), then set 

(36) 
(37) 
(38) 
(39) 



4. If TOi e .F 2 (i - 1) \ Ci{i - 1) then 





= £i(t - 


1), 




= .Fi(»- 


1), 




= {m}, 






= Ti{i- 


1)U{toJ. 


AW 


= £i(»- 


1), 


^i(i) 


= Fi(i- 


1), 




= C 2 (i- 


l)U{mJ, 


^2(0 


= F 2 {i- 


I)- 



(40) 

(41) 
(42) 

(43) 



The algorithm is guaranteed to end in a finite number of steps, since at each step (except at the 
last step) either the number of agents in T\ U T 2 increases, or the number of agents in T\ U T 2 remains 
unchanged and the number of agents in L\ U £ 2 increases. □ 
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